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Abstract 
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I. INTRODUCTION 


The development of non-equilibrium equalities, such as the fluctuation theorems and the 


Jarzynski equality, is one of the major advances in statistical physics since 1990’s By. 
Those relations entail the information about the fluctuations of the entropy production in a 
stochastic environment, and are used in deriving the second law of thermodynamics. They 
are generalized to the systems with measurements and feedback controls, and the relation 
between the extractable work and the information obtained by the measurement is clarified 


14 


16); thereby the paradox of Maxwell’s demon is fully understood [15|]. Incorporation 


of information processing into thermodynamics is a topic of considerable interest recently 


17 


24], 


Information is a key to success for gamblers, as well as for demons. The purpose of this 
paper is to argue that a similar theoretical framework can be developed for gambling 1 . The 
close connection between the capital growth rate in gambling and information theory is first 
noted by Kelly in 1956 j^fj. He showed that the optimal growth rate of wealth in repeated 
horse races is bounded from above by an information-theoretical quantity, which is the 
channel capacity 27]. Kelly also considered a gamble with a help of an informant who tells 
the results (which can be wrong) to the gambler before betting. Kelly pointed out that the 
increase in the maximum of the average capital growth rate because of the information from 
the informant, called “side information,” is quantified by the mutual information between 
the side information and the results of the gamble. The idea to maximize the log of the 
capital, called the Kelly criterion, is first applied to actual gambling j^J and stock investing 


29) by Thorp, who is the inventor of the card counting 2 in blackjack |30). The theory 


of Kelly is introduced into a wider audience by the book “Fortune’s formula” written by 
Poundstone [31]. 


In this paper, we derive several equalities that constrain the statistics of the capital growth 
rate in gambling. We first consider a repeated gambling of binary options, each game of 
which is independent and identical, and we derive Jarzynski-type equalities in this case. In 
the presence of side information, the equality includes the mutual information between the 


1 The analogy between the work extraction in a feedback control system and gambling is recently discussed 
in Ref. Q. 

2 Card counting is a method to improve a gambler’s return by utilizing the information of dealt cards. 
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side information and the outcome of the gambling. We then extend the equalities to the 
cases with memory effects, in which the outcome of a game can be dependent on the results 


in the past. In the case of garnb 
the directed information 132 


ing with side information, we obtain an equality involving 
, which is a measure of causal correlations. The derived 
Jarzynski-type equalities elucidate the role of information in capital growth in gambling. 
We find that, applying Jensen’s inequality to the equalities, the upper bounds of capital 
growth rates are reproduced, which is analogous to the derivation of the second law of 
thermodynamics from the Jarzynski equality Some of the equalities in the case of 
independent games of gambling that we show here are also derived by Bell and Cover using a 
different line of reasoning 34], In that sense, our main contribution lies in the generalization 
of those relations to gambling which has memory effects. Still, for the sake of illustration, 
we start with discussing independent games of gambling. 

The paper is organized as follows. In Sec. [TT1 we review the Kelly criterion in games of 
binary gambling which are independent and identical. We illustrate how the upper bound of 
the average capital growth rate is related to the concepts in information theory. In Sec. IIII1 
we derive several Jarzynski-type equalities for independent games of binary gambling, and 
discuss their implications. We introduce a quantity called efficacy as a measure of how 
well the gambler bets as well as the quality of side information. In Sec. IIV1 we extend the 
Jarzynski-type equalities for the binary gambling with memory effects, in which the results 
can be dependent on the ones in the past. We further generalize the relation to horse races, 
which includes the binary betting as a special case. The efficacy is also generalized to the 
case with memory effects. In the last section of Sec. IIV1 we give the unified expression 
of the Jarzynski-type equalities in gambling discussed in this paper. Section [V] is devoted 
to summary and outlook. In Appendix [A] we summarize the notations for information- 
theoretical quantities used in this paper. In Appendix |Bj we discuss how the Markovian 
coin tossing discussed in Sec. [IV] is mapped to the ID Ising model. 


II. KELLY CRITERION AND INFORMATION THEORY 

Let us start by giving a pedagogical review on the Kelly criterion and its relation to 
information theory, using a repeated binary gambling where the results are independent and 
identically distributed (i.i.d.). We demonstrate that the upper bound of the average capital 
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growth rate is written in terms of quantities in information theory. In Sec. Ill Al we discuss 
a simple gambling with binary options and introduce the notion of the Kelly criterion. In 
Sec. Ill ESI we study the effect of side information on capital growth. 


A. Kelly criterion 


Let us consider simple games of gambling. A player has binary options to bet in a game. 
If the player wins, the casino pays twice of the betted money to the player. The player 
repeats the game many times. Let us denote the fraction of money that the player bets on 
the i-th game by /,;. The outcome of each game is assumed to be i.i.d. in this section. We 
denote the player’s capital before f-th game by M t . The capital evolves as 

f MAl + fi) win 

Mi — > { K ’ . ( 1 ) 

[Mi(l- fi) lose 

We introduce a stochastic variable 6 {1,-1} to indicate whether the player has won or 
lost in the f-tli game. The evolution of the capital is written as 

Mi + 1 = Mj(l + fit/i). (2) 


The question is: how much should the player bet in order to make money as fast as possible? 
Kelly’s recipe is the following. Let us define the growth rate of the player’s capital during n 
games by 


/ rn\ _ ^ i M ^ n -|_i 

9n{f = - In——, 
n M\ 

which is a function of the betting fractions f n = {/i, • • • , / n } 3 . 
trollable variables for the player. Kelly’s advise is to choose f n 
the average of the capital growth rate ([3l) , which is written as 


( 3 ) 

The fractions f n are con- 
in such a way to maximize 


(9n(f n ))yn 



1 

- \pi ln(l + fi) + Pi ln(l - fi )], 


( 4 ) 

where Pi (pi = 1 — pf) is the probability for the player to win (lose) in the i-th game, and 
(• • •) means the average with respect to the variable y. We denote the optimal fractions 
by f* n = {/*, • • • , /*}. Since all the games are i.i.d., pi — ■ ■ ■ — p n = p, and the optimal 


3 We use the superscript to denote the variables collectively in this paper. 
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fractions are all the same, f * = ■■■ = f* = f*. Thus, (g n (f* n )) y u = (gi(fi)) yi = ( g(f*)) y 
and we have only to consider the average capital growth rate in one game. The solution of 
d ( g(f)) y /df = 0 is readily obtained as 

f*=P~P, ( 5 ) 


where p = 1 — p. This choice of the betting fraction to maximize the average of the log 
of M n+ i/Mi is called the Kelly criterion 26], Breiman showed that the Kelly strategy 
asymptotically surpasses other strategies in the long run [35]. Since f* should satisfy 0 < 
f* < 1, p should satisfy p > 1/2. f* < 1 holds for any value of p. When p < 1/2, the player 
should not bet, namely f* = 0. The maximum of the average capital growth rate ( g(f *)) is 
given by 

(g(f*)) — ln2 — S(Y), (6) 


where S(Y) is the Shannon entropy of the outcome, which can be written as S(Y) = <5*2 (p) = 
—plnp —plnp. If p is close to 1, S^p) — 0 and ( g(f *)) — In2, which means that the player 
can almost double the capital every game. On the other hand, if p ~ 1/2, S 2 (p) — In 2 
and the player can hardly increase the capital. Kelly noted that the capital growth rate (f6j) 
under the Kelly criterion is nothing but the channel capacity of a binary symmetric channel 
with error rate p (or 1 — p). 

The variance of the growth rate for general / is written as 


v 


[9\ = {gl(f)) - (gn(f)Y 

1 + /' ° 


= pp 


In ■ 


1 -/ 


In the case of Kelly betting (/ 


/*), 

v[g(n] 


pp 



( 7 ) 


( 8 ) 


Although the Kelly betting is most profitable in the long run, it is known to be very risky 
in a short term and the capital suffers from large fluctuations. In order to reduce the risk 
of ruin, a popular strategy is the “fractional Kelly bet,” in which a gambler bets a certain 
fraction (say, 1/2) of the Kelly fraction. 
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B. Binary gambling with side information 


We here consider the binary gambling in the presence of side information. All the games 
are assumed to be i.i.d. in this section, and we have only to consider the capital growth rate 
at one game. The result of a game is denoted by y G {1,-1}. The player receives the side 
information x before betting. We denote the probability distribution of the outcome y for a 
given side information x by P(y\x). The player determines the fraction of the capital to bet 
based on the side information, so the fraction depends on x, f — f x . The capital evolves as 

Mi + 1 = Mj( 1 + f x y ). (9) 

We define the capital growth rate as 

g(fx) = In = ln(l + f x y ). (10) 

jVLi 

Let us calculate the maximum of the average capital growth rate in this case. The Kelly 
fraction for a fixed x is given by f* = P(y = l|x) — P(y = — l|x). It follows that 

l + f* x y = 2P(y\x). (11) 

The average capital growth rate under the Kelly betting is given by 

w:)) x ,y = ^2 p ( x ,y) ln2P(j/|x) 

x >v ( 12 ) 

= \n2-S(Y) + I(X : Y), 

where P(x, y) is the joint probability of x and y, S(Y ) = — (In P(y)) is the Shannon entropy, 
and I(X : Y ) = (In [P(x, y)/P(x)P(y)]) is the mutual information. This is the maximum 
of the average capital growth rate in the presence of side information. The first two terms 
are the upper bound in the absence of side information. The third term is the additional 
contribution from side information. With the help of side information the upper bound 
of the capital growth rate is increased by the amount of the mutual information between 
the side information and the result of the gamble, I(X : Y). This relation quantifies the 
financial value of side information. 

Let us see this in a concrete example. We consider the case when the player receives the 
side information of the form x G {1,-1} from an informant before betting. The value 1 


7 



TABLE I: Joint distribution of the side information and the result of a game, P(x,y), and the 
money after betting in the unit of the capital before betting. 


(*,y) 

P(x,y) 

ratio 

(- 1 ,- 1 ) 

pq 

1-/-1 

( 1 , 1 ) 

pq 

l + /i 

(- 1 , 1 ) 

pq 

1 + /-1 

( 1 ,- 1 ) 

pq 

l-/i 


(—1) means that “the player is going to win (lose).” Unfortunately, the information from 
the informant can be wrong. Let us model the conditional probabilities as 


p 0 = l \v = i) = P{x = -i| y = -i) = q, 

P{x = —1| y = 1) = P(x = 1| y = —1) = 1 — q = q, 


(13) 


where q is the parameter to quantify the correctness of the side information. The probability 
for a player to win (lose) is denoted by p (p). The average of g(f x ) is (see Tabled]) 

Wx)) x ,y = ^2P(x,y) ln(l+/^) = pqln(l-f-i)+pqln(l+fi)+pqln(l+f-i)+pqln(l-fi). 

x,y 

(14) 

We can determine the the fractions /J 1 and /-j* which give the maximum of (g{f x )) xy by 
solving d ( g{fx)) X}y /d.f\ = 0 and d (g(f x )) Xjy /df- 1 = 0. The solution is 


s* _pq- pq t* _pq — pq 

j -1 — -. - i j i — . —• 

pq + pq pq + pq 

The maximum of the average capital growth rate reads 

/ - i 2 Pq , -i 2 pq , , 2 pq , —, 2 m 

\9\fx)) x v = pq ln -+ pq ln -+ pq In-+ pq In ■ 


(15) 


x,y " " pq + pq pq + pq pq + pq ‘ ‘ pq + pq 

= ln2 -S(Y) + I(X :Y), 

where S(Y) = S2 (p) = —plnp — pin p, and we used P(x = 1) = pq + pq and P(x = —1) = 















III. JARZYNSKI-TYPE EQUALITIES FOR INDEPENDENT GAMES OF GAM¬ 
BLING 


From the discussion so far, we have learned that the average capital growth rate in 
gambling is bounded from above, 


9(f) < In 2 — S(Y), 


(17) 


in the case of the binary gambling without side information, for example. This relation 
can be regarded as the “second law” in casinos. If one recalls that the second law of 
thermodynamics is derived from an Integral Fluctuation Theorem (IFT), one might wonder 
that there may also be a corresponding IFT-like equation which leads to Eq. era- As is 
shown below, there actually exist such equalities for all the situations discussed in Sec. [TT1 
Below we take the outcome of gambling y to be asymmetric, y G { R , — .R}, where R and 
R are positive numbers. We introduce the following quantity, 


Q(y = R) 


R 

R + R ’ 


Q(y 


-R) 


R 

R + R' 


Q(y) can be regarded as a probability distribution, since Q(y) € (0 : 
An important property of Q(y) which is used later extensively is that 
Q(y) vanishes, 


(18) 

!) and ^2 y Q(y) = 1. 
the average of y over 


5>Q(2/) = °- (19) 

y 


We also denote 


Sy = -ln<2(»). 


( 20 ) 


A. Simple binary gambling 


In the gambling of simple binary betting without side information discussed in Sec. Ill Al 
the following equality holds. 

Theorem. 1 Let g(f) be the capital growth rate with a betting fraction /. g(f) satisfies 

(exp [g(f) + s y -sQ]) y = 1, (21) 

where s y = — In P(y), average of which is the Shannon entropy, (s y ) = S(Y). 4 


4 


In the context of non-equilibrium physics, s y is called as the trajectory (stochastic) entropy 
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Proof. 

LHS=^(l + /»>!!!) =E( 1 + /»WW = 1 ' ( 22 ) 

where we used the normalization of Q(y), and ^2 y Q(y)y = 0. ■ 

Equation ()2TT) expresses the balance between the growth rate and the (stochastic) entropy 
of the results. We can reproduce the upper bound of the average capital growth rate under 
the Kelly strategy from Eq. (l2T]h Because of the convexity of the exponential function 
(exp [(F)] < (exp F)), Eq. (j2Tj) implies 

W))« < D KL (P(y)\\Q(y)), (23) 

where -Dkl('H') is the Kullback-Leibler divergence (see Appendix lAl for definition). In the 
case of even-money betting (y G {1, —1}), the bound of the growth rate is written as 

(g(f))y — In 2 — S(Y), (24) 

which equals to the upper bound of the capital growth rate (J6J) obtained by explicitly max¬ 
imizing (g(f)) y . 


B. Binary gambling with side information 


In the gambling with binary options under side information discussed in Sec. IIIB1 the 
capital growth rate satisfies the following equality. 


Theorem. 2 Let the betting fraction f x , which is a function of the information x from an 
informant. The capital growth rate g(f x ) obeys 


(exp [g(f x ) +s y - i xy - s%] ) xy = 1, (25) 

where i xy = In [P(x,y)/P(x)P(y)\, which gives the mutual information when averaged, 

(;*») = I(X : Y). •- 


5 In the discussion of non-equilibrium equalities, i xy is introduced in Refs, 
counterpart of the generalized Jarzynski equality under feedback controls. 



Equation (E5l) is a 
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Proof. 


(exp [g(f x ) + s y - i xy - s%] ) x y = /(I + f x y) 


Q{y ) 

p (y \ x )/ *, y 
P{x,y)Q{y) 


= ^ {1+Ly) nv\*) 

= + fxy) P( x )Q{y) 

x,y 

= 1, 


( 26 ) 


where we used the normalization of Q(y), and Y2 y Q(y)y = 0 in the last line. ■ 

Equation (J25J) constrains the statistics of the capital growth rate, the entropy of the 
results and the obtained side information. By using Jensen’s inequality exp [(F)] < (exp F), 
one can derive the upper bound of (g(f x ))x,y, 


{.g(fx)) x ,y < D KL (P(y)WQ(y)) + I(X : Y). (27) 


In the case of even-money betting (y G {1, — 1}), 


{9{fx))x,v < In 2 - S(Y) + I(X : Y), (28) 

which coincides with Eq. (1T21) . Again, we were able to derive the Kelly bound from the 
equality (J25]). 

In the presence of side information, the RHS of Eq. (12T| deviates from unity. Let us 
denote this quantity as 7 , 

7 = (exp [g(f x ) + s y - s£] ) x y , (29) 

which can be also written as 


7 = 1 + Y S*v p i x \v)Q (»)• 


(30) 


x,y 


We refer to 7 as efficacy 


16], since 7 is a measure of how effectively the player uses the side 


information. This meaning is evident if one expresses 7 as 

(exp [A-xy ^xy \) 


7 1 = 


(31) 


(exp [A xy ]) (exp [-i xy ])' 

where A xy = g(f x ) + s y — s®, and we used Eq. (1251) and a trivial identity (exp [— i xy ]) = 1. 
Thus, 7 is a measure of correlation between A xy and the mutual information i xy . If the side 
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information has no effect on the capital growth, 7 = 1. It can be larger than 1 when the side 
information contributes to increase the capital growth. To see this explicitly, let us model 
the conditional probability P(x\y) as 

P(x = —R\y = —R) = P(x = R\y — R) — q, (32) 

P(x = — R\y = R) = P{x = R\y = —R) = q. (33) 

The parameter q quantifies the correlation between x and y. The value q — 1/2 corresponds 
to no correlation, and q — 1 means a perfect correlation. With parameter q, the efficacy is 
expressed as 

JDTD 

7 = i + ^ T ^(/i-/-i)(g-g). (34) 

In the case of no correlation (q = q = 1/2), the efficacy is unity, 7 = 1 . Even if q ^ 1/2, if 

the player just ignores the obtained side information (J\ = /_ 1 ), 7 is again unity. If q 7 ^ 1/2 

and the player bets well, 7 becomes larger than 1 . 

As we have seen above, the efficacy depends on the choice of betting strategy, as well as 
the nature of side information. When the gambler chooses the Kelly strategy, the efficacy 
takes a simple form, 

7 * = (exp [i xy ]) x y = Y p (x\y)P(y\x), (35) 

x, y 

where 7 * is the efficacy under the Kelly strategy. The upper bound of 7 * can be found as 

7 * = (exp [i xy ]) x y = (exp [s y - s y \ x ] ) xy < (exp [s„]) y = Y 1 = Ny ’ ( 36 ) 

y 

where s y \ x = — In P(y\x) and N y = 2 is the number of possible outcomes, and we used the 
property s y \ x > 0 . 

The efficacy can be used to detect the use of side information in gambling. Suppose 
there is a gambler in a casino and we do not know whether the gambler is secretly using 
insider information. If we know how much the gambler bets, the results of the gamble, 
and the probability distribution of the results, we can calculate the quantity inside (• • •) in 
Eq. ([29]) . Observing the gambler’s behavior in a number of games and taking the average, 
we can evaluate the efficacy. The efficacy deviates from unity if the gambler is using the 
side information. 
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C. Remarks 


Several comments on the equalities derived in this section are in order. 


• The obtained relations hold for any choice of betting strategy /, and it is not restricted 
to the Kelly betting. This is similar to the case of the Jarzynski equality, which holds 
for any far-from-equilibrium processes [3| . 

• In all the cases discussed above (except for the one involving the efficacy), the obtained 
equalities can be rewritten in the following form, 

= l, (37) 


which can be verified by noting 1 + f*y = P(y)/Q(y) for the case without side infor¬ 
mation or 1 + f*y = P(y\x)/Q(y) in the presence of side information. Equation (137|) 


was derived in the case of stock investing by Bell and Cover 


34J in a different way. 


Since gambling can be treated as a certain form of stock investing, Eq (1371) is a special 
case of their result. In Sec. m we generalize this equality to gambling with memory 
effects. 


IV. JARZYNSKI-TYPE EQUALITIES FOR GAMBLING WITH MEMORY EF¬ 
FECTS 

So far we have assumed that all the games are independent and identical. Here let us 
consider more general cases where each gambling can depend on the results in the past. 
Namely, we work on the gamble with memory effects. We will find that the Jarzynski- 
type equalities can be generalized to those cases. In Sec. IIV A1 we discuss binary gambling 
without side information, and we consider the case with side information in Sec. IIV Bl In 
Sec. IIV Cl we generalize the equality to more general class of gambling with arbitrary number 
of options and arbitrary payment functions. In Sec. IIV Dl we give a unified expression of 
the equalities derived in this paper. 
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A. Simple binary gambling 


Here we generalize the simple binary gambling without side information to the case with 
memory effects. We define the capital growth rate during n games as 


UnU") = - In 
n 


M n +1 

Mi 


1 

n 


J2 ln 


M i+1 

~mT 


[1 + /,;( , 


(38) 


where /* is the bet fraction on i-th game, and y* G {/?, —.R}. The dependence of / on i 
means that the player can change the betting strategy adaptively. The fraction /', = /j(y i_1 ) 
is a function of the results in the past, y l ~ l = {yi, ■ ■ ■ , yj_i}. The average of the capital 
growth rate is written as 

<*,(/”)}„» = V P(V)j„(/ n ). (39) 

y n 

where P(y n ) = P(yi, ■ ■ ■ , y n ) is the joint probability of the results of the games. 

We define a probability distribution Q(y n ) by 


w)= 

i 


where Q(yi) is defined by Q(yt 
use the properties of Q(yi), 


and 


We also denote 


R) — R/(R + R ) and Q(yi 
^Q(yi) = i, 

Vi 

^ViQivi) = o. 

Vi 

v = -\^qun- 


(40) 

—R) — R/(R + R). Later we 

(41) 

(42) 

(43) 


Theorem. 3 For binary gambling with memory effects, the capital growth rate g n (f n ) 
satisfies 


where s y n 


In P(y n ) 



ng n (f n ) + s y n - sju 



-hiP(yi, • • • ,y n ). 


1 , 


(44) 
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Proof. 



ng n {f U ) + Syn - Syn 



n 

Y nc 1 + My'^ydQivi) 

y n i =1 

n —1 

Y ( x + fniv^vn) Q{y n ) na + My'^ViMvi)- 

y n i =1 

(45) 


Expanding the first bracket, the second term vanishes on summation over y n due to Eq. (1421) . 
Repeating this procedure, 


exp 


ng n (f n ) + Sy 




Ew) = 1 . 


(46) 


where the normalization of Q(y n ) [Eq. fldT]) ] is used. 
Applying Jensen’s inequality to Eq. MM leads to 


(gn(f n )) v n < -D KL (P{y n )\\Q{y n )). 


n 


The inequality (l47|) is saturated by choosing the betting fraction as 

RP(yi = RW- 1 ) - RP{yi = - R\y i_1 ) 


/* = 


RR 


(47) 


(48) 


With this choice of fraction, 


1 + ftVi 


P(yi\y i *) 
Q(yi) 


and the average capital growth rate is indeed 


(49) 


<*,(/•”)}„» 


n 


E E ln 


i=l 


Pjyily* *) 
Q{yi) 


(50) 


= RklW)iiq(v)). 

where we used the decomposition of the joint probability P(y n ) = P(y i \y l ~ 1 ). In the case 

of even-money betting (jji G {!,—!}), 


(9„(/")>„»<ln2-is(W), (51) 

where S(Y n ) = — (In P(y n )) yn is the entropy of the outcomes. The maximum of the average 
capital growth rate is determined by the entropy of y n , S(Y n ). Namely, the amount of 
uncertainty rules the amount of money a gambler can make. The more predictable the 
sequence of y % is, the more rapidly the player’s capital grows. 
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Example (Markovian coin tossing) Let us consider a gamble using a coin. To begin 
with, the dealer places a coin on a table. Then, the dealer slaps the table. The coin flips 

with some probability depending on how strong the dealer hits the table. If the coin is 

a head (tail), the player wins (loses). The next game is done by hitting the table again. 
In this gamble, the results have a Markovian memory effect, P(z/i|z/* _1 ) = P(z/j|z/j_i). We 
parametrize the dependence of the result of z-th game on the previous result as 

P(Vi = Mvi-i = -1) = P(yi = -l\yi-i = 1 ) = e, (52) 

P(Vi = l \Vi-i = 1) = P(Vi = -MVi-i = -1) = e, (53) 

where 0 < e < 1 is a constant and e = 1 — e. The parameter e is the flipping probability of 
the coin. Let us assume that initially the face of the coin is random, P(z / 0 = 1) = P(yo = 
— 1 ) = 1/2, where z / 0 is introduced as a dummy variable and note that actual betting starts 
from n — 1. In this model, P(z/j = 1) = P{yi = —1) = 1/2 for any i and without using 
the correlations, it is impossible to increase the capital. A gambler can make money by 
exploiting the correlation of the result in the next game with those in the past games enables 
a gambler to make money. The entropy of the joint distribution P(y n ) = P{yi, ■ ■ ■ ,y n ) can 
be calculated as 

S(Y n ) = — (hi P(y n )) yn 

n 

(54) 

i=l 

= (n - 1 )S' 2 (e) + In 2 , 

where S 2 (e) = —elne —elne. Note that we use the notation in which P(z/ i |z/ J ) = P(z/j) when 
y t is empty. For example, P(z/i|z/o) = P(y l) dr Eq. (ISTjl . The RHS of Eq. (PXTj) is given by 

77 — 1 

RHS =-[In 2 - S 2 (e)]. (55) 

On the other hand, we can explicitly maximize the growth rate by choosing the fraction 
so that 1 + f*yi = 2P(z/j|z/j_i) is satisfied. The average capital growth rate with this choice 
of fraction is 

1 n 

(9n(r)> s . = -E< ln ( 1+ ^»)> 

y n A ' 

i=i 
1 _ n 

i=l 

= !i_i.|| n2 -S 2 ( £ )], 
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which coincides with the bound (154|) . and the inequality (147|) is saturated. Since the achieved 
growth rate (l54|i is positive, the player has a chance to increase the capital, unless the flipping 
of the coin is completely random (i.e., e = 1/2). 

The Markovian coin tossing discussed here can be mapped to the ID Ising model, as 
described in Appendix [JO The sequence of the results of the coin toss is identified to the 
configuration of Ising spins in one dimension. 


B. Binary gambling with side information 


We here work on the binary gambling with memory effects and side information. On the 
f-th game, the player determines the betting fraction based on the outcomes in the past y l ~ l 
and the side information x l = {aq, • • • , aq}, so the fraction is written as fi = fi(x l , y 1-1 ). 
The capital growth rate during n bets is defined as 


(. gn(f n )) 


x n ,y n 


n\ M x / xn . 


We can show a Jarzynski-type relation in this case as well. 


(57) 


Theorem. 4 For binary betting with memory effects and side information, 



n 9n{f n ) + Sy n 


^x n —^y n 



x rL ,y n 


i. 


(58) 


where 

P(v n \\r n ) ^ 

s y n = -In P(y n ), i x n^ y n = In , s^ n = - In Q (y n ). (59) 

The expression P(y n \\x n ) = ]/[ i P(y i \y t ~ 1 , x l ) is the probability distribution of y n causally 
conditioned on x n . 
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Proof. The LHS of Eq. (I58|) is calculated as 


exp 


Q 


^9n(^f ) T $y n ^x n —}y n ^y 


x' L ,y' L 


Yli^P M x \y i ^y^Qiyi) 

P(y n \\x n ) , x „ tyn 

E^^}n d+/.(< ! /‘- i )»)Qfe 


y' L ,x' 


E p ( I “ll»”" 1 ) IE + /,(*<, s'-'JkJQW 

j n ,x n i 

nu + Mx^y^yJPixilx^’V^Qiyi) 


y n ,x n i 


(60) 


where we have used the decomposition of the joint probability P(y n ,x n ) = 
P(l/ n ||x n )P(a; n ||y ri_1 ), and the definition of P(x n \\y n ~ 1 ) (see Appendix [All . Let us define 
Ai(y\x l ) = (1 + fi(x\ ?/*” 1 )|/j)Q(?/ i )P(x i |x*^ 1 ,2/ 1-1 ). The expression 4k can be written as 

n 

* = UMvW) 

y n ,x n 2=1 

72—1 

= E (si) 

y n ,x n 2=1 

72—1 

= ^ l 1 + < 5(^) P ( X nk n " 1 ,2/ n_1 ) JJ Ai(|/ l ,P). 

y n ,x n 2=1 


If we expand the bracket in the last line, the second term vanishes because it is lin¬ 
ear in y n and ^ y n Q(yn) = 0. Performing the summation over x n (note that 
Yhx n P{ x n\x n ~ 1 i y n ~ l ) = 1), and repeating the same procedure for n times, 

72—1 

*= E wll- 4 *'' 1 ^ " = Ew = l ■ ( 62 > 

y n x n-l i= 1 y n 


Using Jensen’s inequality to Eq. fl58j) . we obtain the bound for the average capital growth 
rate as 

( 9 »(r)U„» < U>KL(W)IIQ(y”)) + Ud,(V" -4 V”), (63) 

where 


^dr(A 7 ' —> Y n ) = (z x n ~^y n ) x n y n — ( hi 


P(y n \\x n ) 

P(y n ) 


(64) 


x ,b ,y n 
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The quantity Idv(X n —> Y n ) is the directed information from X n to Y n , which is a measure of 


causal correlations 


32 


33 


37]. Correlational measures such as the mutual information and 


cross correlations between X and Y are symmetric under the exchange of X and Y, and can 
not capture the directionality of influences. The directed information quantifies “directed” 
flow of information and is useful in uncovering the causal influences among interacting 
systems. The inequality (1681) is saturated when the player bets the fraction 

RP{yi = - RP{yi = -R\y l ~ l ,x l ) 


/; = 


RR 


(65) 


This choice means that “the player should bet the Kelly fraction based on all the available 
information.” With this choice of fraction, 


1 + ftVi = 


P(yi\y l ,x 
Q(y %) 


( 66 ) 


and one can readily check that Eq. (1631) is saturated. In the case of symmetric betting 
(y G {1,-1}), D KL (P(y n )\\Q(y n )) = n In 2 — S(Y n ) and the upper bound of the average 
capital growth rate is written as 


(9n(F)) x n yn < In 2 - -S(Y n ) + -4(r Y« 
,y n n 


(67) 


Example (Markovian coin tossing with side information) Let us discuss an ex¬ 
tension of the Markovian coin tossing in the previous section. The dealer slaps the table and 
tries to flip the coin, as before. This time, the flipping rate on the i-th game is a stochastic 
variable. The player infers the flipping rate (the strength for the dealer to slap the table) 
from the dealer. We denote the flipping rate of the coin as 


P(yi\yi-i,9i) 


{ Si Vi ^ y%- 1 , 
Vi Vi— 1) 


( 68 ) 


where G [0 : 1] is a stochastic variable. The player measures the flipping rate, and 
determines the betting fraction based on the measured rate. We assume that the initial face 
of the coin is random, P(yo = 1) = P(yo = — 1) = 1/2. 
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Let us calculate the RHS of Eq. (j6T|) . The directed information from @ n to Y n reads 

P(y n \\8 r 


/ dr (0 n ^Y n )=( In 


P(y r 


Qn y n 


{\i\P{y 1 \e l )) yiei + ^{\nP{y i \y i _ ll d i )) yuy . iA +S{Y n ) ( 69 ) 

i=2 

n 

-in2-J](s 2 (e ( ))„ i + s(y”), 


i =2 


where S 2 (p) = —p hi p — p In p is the binary entropy function, and we used P(yi) = 1/2 since 
the initial state of the coin is randomly chosen. If the face of the coin is independent of the 
measured flipping rate, P(r/j|r/j_i, 9i) = P(r/j|r/j_i), then the directed information vanishes, 
J dr (@ n —» Y n ) = 0. Thus, the RHS of Eq. (1571) is written as 


— 1 1 _ \ 

RHS =^—In 2 --J2(S 2 (9i))t 


n 


(70) 


1=2 


The capital growth rate under the Kelly betting is calculated as follows. Noting that 

1 + 0 l )y t = 1 + f(y^ h Bi) yi = 2P(y i \y i _ l , 9 Z ), (71) 


the average capital growth rate is 

1 71 

{9(f”)W = - E ( ln (! + f(y '-\»•)!/.)> 

i =1 
n 

= -V(lu2P(^| ?/j _ 1 ,^)) + - (ln 2P(y 1 \9i)) (72) 

n ' n 

i =2 

1 -« 71 

= — I" 2 - E^^b’ 

n n 

i =2 

where we again used P(yi) = 1/2. This coincides with Eq. (ITU)) and the inequality (157)) is 
saturated. 

Suppose 9i obeys a Gaussian distribution with mean p and variance a 2 , and 9 t for different 
i are independent. When o is small compared to p and p = 1 — p, the directed information 
Jd r (0 n —>■ Y n ) is approximated as 

( n — llfT 2 

/ d r(e n -► n ~ 1 J ■ (73) 

ipp 

The additional contribution to maximal capital growth rate due to the side information, 
6 ( 9*) = (g(f* n ))e--,yn - (g(f* n )) y n, is thus written as 

1 77 - — 1 (J^ 

5 (g*) = — / dr (0 n Y n ) ~-— . (74) 

n n 2pp 
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Thus, the randomized flipping rate 9i always helps the gambler, and it is an increasing 
function of the variance of the flipping rate. 

Let us find the expression for the efficacy assuming that the gambler obeys the Kelly 
strategy. The efficacy can be defined in an analogous way in to the memoryless case [see 
Eq. f!92p ]. As will be shown in the next section, the efficacy under the Kelly strategy is 
written as 7* = (exp [ien^ y n]) l ^ n . We can calculate 7* as 

P(y n ,9 n )P(y n \\9 n ) 


, *\n , r . n / P(y n \\o n ) 

(7 ) = (exp ^ p 


E 


y ,X ,b yn Qn 


P(y ri 


II 


(75) 


P(yt\yi -u 


y n ,0 n i =2 

Noting that P(y h 9i\y^i, 6 W 1 ) = P(y h 9 i \y i - 1 ) and P{y u 9i\yi-i) = P(y i \y i - 1 , 9 i )P(9 i \y i - 1 ) = 
P(y i \y i -i,9 i )P(9 i ), 


, *\n P(yi>0i)P(yi\0i) P(yi\yi-i>Qi) 2 P(Qi) 

(7) = z — pm — n 


-P(silffi-i) 


(76) 


y n ,0 n ' ' i=2 

The summation in Eq. (j76li can be calculated in a similar way to the transfer matrix method 
for the ID Ising model. In the current model, the marginal flipping rate that appears in 
Eq. (l75]i is written as 


p(y, = E p (v„»,\v,-i) = E p fe< \vi-iA)PW = { " (77) 

Oi 9 i 


Let us define matrices B~ as 


[ZJ ( ]„ „ t Vi-iAYPjOi) Inr 1- 


P Vi = Vi-1- 


p 2 + <J 2 p 2 +a 2 


e t 


P(vi\yi -1 


V V 

p 2 +P P 2 +<T 2 
p p 


(78) 


7!) M 

P P 

The matrices Bi are in fact all the same and we denote them as B = Pj. Noting also that 
P(yi) = P(yi\9i) = 1 / 2 , the efficacy can be expressed by the product of those matrices as 

2 


( 7 ’)” = E 

a= 1 
2 

= E 


a= 1 


ID 

7=2 

(B) 


1/2 

1 / 2 , 

-1 (1/2 


. 1 / 2 , 


(79) 


a 


1 + Pp) 


2 \ n ~ l 
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Thus, in the current approximation, the efficacy and the directed information is related by 
(from Eq. d73|) and Eq. (f79l) l 


7* = 1 + 


n 


-J dr (0" -y Y n ) 


i-- 


(80) 


Generalization: horse races with side information 


We here generalize the Jarzynski-type equalities to a gambling in which the players have 
multiple options to bet with a help of side information 6 7 . This situation actually corresponds 
to horse races in which each result of a race can depend on the results in the past. Horse 
races can be regarded as a generalization of the cases of binary betting discussed in the 


previous sections. 


race, see Refs. 


39 


'or the discussion of the upper bound of the capital growth rates in horse 


4l| 


Let f(yi) and o(?/j) be the bet fraction and the odds on the horse yi in the z-th race. We 
take Yly f(Vi) = I; which means that the gambler bets all one’s money in every race. The 
capital of the gambler evolves as 


M i+ 1 = Mif(yi\y l ,x l )o(yi\y 


i— 1\ 


(81) 


where yi is the horse that won the i-th race, and Xi is the side information for the i-th race'. 
The gambler determines the betting fraction according to the past results and the received 
side information, thus f(yt ) = /(t/i|t/* _1 , x 1 ). The odds o(y i \y 1 ^ 1 ) are also a function of the 
results in the past. The gambler’s capital during n races is written as 


V n+1 — MiY[f(y i \y 1 1 ,x , )o(y i \y' '). 


(82) 


i =1 


We define the capital growth rate after n races as 


/ rn n\ 1 1 1 

qjf ,o ) = — In ——— 
y u ’ ’ n Mi 


= -In/(y"||x")o(y»), 
n 


(83) 


6 As another extension, we can also formulate the Jarzynski-type equalities in gambling with more complex 
information structures using the Bayesian network. The proof of the equality is almost the same, we just 
have to replace P(x n \\y n ) with P c (x n \\y n ) = JX' 1 P(xi\pa,(xi)) and similarly for f(y n \\x n ) and o(y n \\x n ). 
See Ref. 


7 The quantities / and o in Eq. m correspond to (1 + yf)Q{y ) and 1/Q{y) in the case of binary betting 
discussed in the previous subsections. 
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where 

n n 

“(»")=iu^t- < 84 ) 

2 2—1 

Theorem. 5 In horse races with memory effects and side information, the capital growth 
rate g n satisfies 


{exp [ng n (f n , o n ) + - liio(y")]) yn a . n = 1, 


(85) 


where 


- - In P(y n ) -• _ Y P(y n \\x n ) 

s y n — — 111 - r ly b lx n ^y n — 111 — P( K y n )—' 


( 86 ) 


Proof. 


(exp [ng n (f n , o n ) + s y » - i x n^ y u - In o(y n )}) yn xn = ^ p^ y l \ 

= E f(y 


n "x n 


y n : x n 

P(y n ,x n ) 


y -, x 


P(y n \\x n ) 


(87) 


y n ,x n 

= 1, 


where we have used the decomposition of P(x n ,y n ), and 

£/M*”)i’(*”l|y”“ 1 ) = l- 


( 88 ) 


y rL ,x n 


This relation can be shown by noting /(|/j||/* *) = 1 and 'ff x . P(xi\x l 1 , y l x ) = 1. 


Using Jensen’s inequality, we obtain the bound for capital growth, 

wr,‘ (>"«(!/”)>„».,• - U(r”) + U*(X” n. ( 89 ) 


n 


< yiL X n 


n 


n 


where we have used (i x n ->-y n ) x n y -n = /dr(^ n —> U n ). Under the “fair and uniform” odds 
(o(?/i||/* _1 ) = M for any i, where M is the number of horses in a race), 


(. g n (f n ,o n )) ynxn < In M- -S(Y n ) + -/*(*" U n ), 
a 1 n n 


(90) 


which reproduces the results obtained in Refs. [401, |4l|. The upper bound fl89l) is achieved 
when the player chooses the betting fraction as 


f( yi \y'-\x') = P( yi \y'-\x') 


(91) 
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The efficacy can also be straightforwardly extended to the case with memory effects, 
which we define as 


7 = ((exp [ ng n {f n , o n ) + s y n - In o(j/ n )]) y „ a 


1/n 


(92) 


The efficacy is also written as 


7 _n — 


(eXp [ A x n y n — ix n ->y n ]} y n x n 


(93) 


(exp [A x n y n]) yn ^ x „ (exp [ 

i J X n ^y n ] ) yn x n 

where A x n yn = ng n (f n ) o n ) + s y n - In o(y n ), and we used (ex.p[-i x n^. yn ]) ynxJl = 1 and 
Eq. (j85]h From the expression (193|) . it is clear that the efficacy measures correlation between 


the capital growth rate and information flow. If the gambler is to take the Kelly strategy, 

/ \ l/n 

the efficacy is written as 7 * = ( (exp [i x n -^y n ]) y n x n ) , which can be shown as 




y',x' 1 


(94) 


( 7 *)” = (exp [ng n (f n , o n ) + s y n - lno(j/ n )]) 

= / f(y n \\x n ) ' 

\ P(y n ) 

/ P(y n \\x n )' 

" \ P{y n ) , 

(eXp [i x n_yy n \)yn x n 1 

where the fact that f(y n \\x n ) = P(y n \\x n ) holds for the Kelly betting is used. The upper 
bound of 7* is found as 

1/n 


1* = ((exp [ix^ y A) y n, x r) 

= ((exp [v “ V II*™])„»*») 


1/n 


< ((exp [s y n]) i 


1/n 


(95) 


E 1 


1/n 


— M, 


where s y n\\ x n = — In P(y n \\x n ) and and we used the property s y n\\ x n > 0. 
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D. Unified expression of the Jarzynski-type equality in gambling 


Here we give the unified expression of the Jarzynski-equalities in gambling. The equalities 
of the form (•••) = ! shown in this paper can be written in the following form, 


<■ 


3 »for, (/")-$»(/*")] 


y' b ,x' 


= i, 


(96) 


where f n are the betting fractions for n games, and f* n are the betting fractions under the 
Kelly strategy. The betting fractions f n can depend on the results in the past, and also on 
the side information. This equality holds regardless of the choice of the betting fractions f n . 
Equation (1961) is a generalization of Bell and Cover’s result 34j to gambling with memory 
effects. 


V. SUMMARY AND OUTLOOK 

In this paper, we derived novel Jarzynski-type equalities in gambling. Based on those 
relations, we discussed how the side information or the memory effects affect the capital 
growth of a gambler. The main results of this paper are summarized as follows: 

• Simple binary gambling —> Eqs. (12T|) and (jUj) 

• Binary gambling with side information —y Eqs. (1251) and (1581) 

• Horse races with side information and memory effects —» Eq. (j85l) 

• Introduction of the efficacy —$■ Eqs. (1291) and (1921) 

The equality for horse races is the most general one. We also gave the unified expression of 
the Jarzynski-type relations shown this paper (except for the one involving the efficacy) in 
Eq. (1961) . Those equalities reproduce the known Kelly bounds of the capital growth rates 
by applying Jensen’s inequality. In the case of betting with side information, the financial 
value of the information is quantified by the mutual information in independently repeated 
gambling and by the directed information for gambling with memory effects. We defined 
the efficacy in Eqs. (1291) and (J92D, which is a measure of how well the gambler makes use of 
the side information. We showed that the efficacy allows for a simple expression [Eqs. (1351) 
and (194)) ] when the gambler bets under the Kelly strategy, and discussed its upper bound. 

Finally, let us comment on possible future directions. 
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Application to actual gambling. An interesting direction is the analysis of actual gam¬ 
bling. A good candidate would be blackjack. In blackjack, a player can improve the 


return by exploiting the information of t 
This method is called “card counting” 


le cards which are already open to the floor. 


30]. The player assigns a number for each 


card, and sums up the number for all the dealt cards. The sum is called the count, 
which is a measure of the card composition of the shoe. The true count, which is the 
count divided by the number of remaining decks, is indicative of the expected return. 
There are many possible choices of the weights on the cards. The performance of a 
counting system is evaluated by a quantity called betting correlation. It is possible to 
estimate the growth rate of wealth under the Kelly criterion as a function of betting 
correlations 8 . 


• Extension to stock investing. Although we focused on gambling in this paper, extension 
of such equalities to stock investing is quite interesting. Such concepts as the Jarzynski- 
equality and the fluctuation theorems developed in non-equilibrium physics might be 
useful in uncovering the role of information in the financial world. 
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Appendix A: Notations and definitions 


Here we summarize notations and definitions of information-theoretical quantities used 
in the text. 

A realization of a stochastic variable X is represented by its small letter, x in this case. 


Mathematical aspects of blackjack are comprehensively analyzed in a recent book by Werthamer [421. 
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Let {x;}, {z/i} be time-sequences of stochastic variables. A variable with a superscript n 
indicates variables from 1 to n collectively, 


x n = {xi, • • • ,x n }. 


(Al) 


We assume that the dependences of the variables x n are causal, by which we mean that 
the probability distribution P(x,) is dependent on Xj only if 3 < i- The joint probability 
P(x n ) is decomposed as 

P(x n ) = Y[P(x i \x i - 1 ), (A2) 

i 

where P(x\y) is the conditional probability. 

The average over variables {x, ?/,•••} is expressed by (• • • ) x .... Subscript may be omit¬ 
ted, in that case the average is taken over all the stochastic variables. 

The Shannon entropy of X n = {Xi, • • • , X n } is 


S(X n ) = - (InP(x n )) a „ = - ^P(x n ) InP(x n ). 


(A3) 


The Kullback-Leibler divergence of a distribution Q(y) from another distribution P{y) is 
defined by 

Ckl^wiiqm) = < A4 > 


The mutual information between the stochastic variable X and Y is defined by 


P(x, y) \ 




P{x,y) 

P(x)P(y)' 


(AS) 


x iU x,y 

We used the following causal conditioning notations developed by Kramer 
probability distribution of x n causally conditioned on y n ~ d is denoted as 


33]. The 


n 


P(x n \\y n ~ d ) = ]JP(x i \x i - 1 ,y i - d ). 


Xn 11 n ,n—d\ _ 

i —1 
,.i—d 


(A6) 


We use a convention that, if i — d < 0, y 1 “is set to null. Mostly, the cases with d — 0,1 
are used: 

n 

(at) 




P(x n \\y n - l ) = \[P(x i \x i -\y i - 1 ). 


(AS) 


i=l 
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The joint probability of x n and y n is decomposed as 


p(x n , v n ) = p(x n \\ y n )p(r\\x’'- 1 ). 

■.■P(x n ,y n ) = Y[P(x„y i \x , - 1 ,v‘- 1 ) 

i 

= l[P(x i \x i -\y i )P(y i \x i ~\y i - 1 ) 

i 

= P(x n \\y n )P(y n \\x n - 1 ). 

The causally conditional entropy is defined as 

n 

S'(X n ||y n ) = - (\nP(x n \\y n )) = J2 S ( X i\ xi ~ 1 > Yi )- 

i =1 

The directed information, introduced by Massey [ 32 I, is defined as 


(A9) 


(A10) 


(All) 


I dr (Y n -a X n ) = ^(X n ) - S{X n \\Y n ). 


(A12) 


It can be explicitly written as 


I d r(Y n ^X n )={ In 


P [x n | \ y r 
P(x n ) 




i 


P(x i+1 \x\y 
P(x i+l \x i ) 


(A13) 


Appendix B: Markovian coin tossing and ID Ising model 


We here show the equivalence of the Markovian coin tossing discussed in Sec. IIV Al with 
the ID Ising model. Without loss of generality, we can parametrize the conditional proba¬ 
bility P(y i+1 \yi) as 

exp \pj y i+ iy r ] 

P{VlM = 2oosh^ • (B1) 

One can see 0 < P(y i+ i\yi) < 1 and the normalization condition P(y i+ i\yi) = 1 is 

satisfied. The new parameter J can be related to the flipping rate e as 


P J = \Y-. 


(B2) 







By rewriting the normalization condition of P{y n ) in the following way, the correspondence 
to the Ising model is evident: 


i = E p (y r 


E exp 

y n 

1 


P(y i+1 \yi) 


(2 cosh I3J) 1 2 3 4 
tr 


E 


exp 


E/v 


Vi+iVi 


(B3) 


Thus, the numerator is the definition of the partition function of the Ising model without 
external fields. The average of the exponential of g is written as 

(exp [ng n ]) yn EwII(i+fc) 

y n i 

(B4) 


1 


^ exp 


P J ln ( 1 + 


(2 cosh /3J) 1 

When fi{yi\y l ~ l ) is independent of y 1-1 , the numerator of RHS is the partition function of 
the Ising model in a weird form of magnetic field. In one dimension, the symmetry breaking 
never occurs in the Ising model at finite temperature. In the context of the Markovian coin 
tossing, the absence of symmetry breaking corresponds to the fact that, at finite values of 
e, the coin flips after finite number of trials, and the “magnetization” always vanishes, 


lim “ 5: (Vi) = °- 

7 .—n * 


n—>oo n 


(B5) 
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